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^ i 1. Introduction 

Let us consider a classical or quantum Hamiltonian given by 

H=^{pl+pl) + V{x,y) (1) 

r~j ■ in two dimensional real Euclidean space, E2. This system is superintegrable if there exist 
^ ■ two independent integrals of motion X and Y. In classical mechanics X and Y must 
be well defined functions on phase space and the triplet (H, X, Y) must be functionally 
independent. The integrals X and Y Poisson commute with H but not with each other. 
In quantum mechanics X and Y must be well defined (Hermitian) operators in the 
enveloping algebra of the Heisenberg algebra (or a convergent series in the generators of 
the Heisenberg algebra) and commute with H. They must be algebraically independent 
within a Jordan algebra generated by Xj, pj and 1. Here, Xi = x, X2 = y and the p^'s 
are their conjugate momenta in the classical system and pj = —ihdxj in the quantum 
system. 

If X and Y are polynomials of order n and m respectively, (with n > m,) 
in the components pi, p2 of the momenta we shall call the system ([T]) n-th order 
superintegrable. 

All second order superintegrable systems in E2 have been known for some time 
[5] as have those in £'3 [HI |3]. Quite generally quadratic superintegrability is well 
understood in Euclidean spaces [H], in spaces of constant curvature [13], and in more 
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general spaces [TT]. In particular, quadratic superintegrable systems are basically the 
same in classical and quantum mechanics. The only difference is that in the quantum 
case operator products have to be symmetrized. Moreover, quadratic integrability 
in system ([1]) is related to the separation of variables in the Hamilton- Jacobi and 
Schrodinger equations, respectively. Quadratic superintegrability is hence related to 
multiseparability. We mention that the best known and most important superintegrable 
systems, namely the Kepler-Coulomb system [3] and the harmonic oscillator flO] are 
quadratically superintgrable on En for n > 2. 

More recently, interest has shifted to higher order superintegrability. Families of 
superintegrable systems with integrals of motion of arbitrary order have been discovered 
both in classical and quantum mechanics [231 IMl l211 [HI |12l |22l [T7] . A systematic search 
for superintegrable systems with one second order and one third order integral of motion 
has be initiated [TJ [6l [25l [201 [IE] . The quantum case turns out to be much richer than 
the classical one. Quantum integrable [H [9] and superintegrable [TJ [6l [25] potentials 
exist that vanish in the classical limit. In other cases, the classical limit {h — )■ 0) is 
singular and the quantum and classical cases are completely different. 

The purpose of this article is to derive a superintegrable system in E2 that does 
not allow separation of variables neither in the quantum case not in its classical limit. 
The integrals of the motion in this case are of order 3 and 4. Previously known 
superintegrable but nonseparable systems [H [I6] are purely classical, moreover one of 
them is complex [16] 

2. 3rd-order integrals 

2.1. Classical and Quantum Determining Equations 

The determining equations for third order classical and quantum integrals of motion 
were derived earlier [7]. They can be presented in both cases in a unified manner. In 
the quantum case, the integral will have the form 

X= l^Jki{Li,p'lp^2} + l{9i{x,y),Pi} + ^{g2{x,y),p2} (2) 

j+k+l=3 

L3 = xp2 - ypi, Pk = -ihdcc^, k = 1,2 (3) 

where Aijk are real constants and the brackets { , } denote anti-commuators. We define 
the polynomials 

/i = -Asooy^ + A2ioy^ - ^102?/^ + Aso (4a) 

/2 = SAsooxy^ - 2A2ioxy + A2oiy^ + A^ox - Amy + A021 (46) 

fs = -SA^ioox'^y - 2A2oixy + Aiox^ + A^x - Aio2y + A012 (4c) 

/4 = ^3002^^ + A20lX^ + A102X + A003 {4:d) 

The commutativity condition [H, X] = implies 4 determining equations for the three 
unknown functions V{x,y), gi{x,y) and g2{x,y) namely 
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(gi). = 3/1 T4 + f2Vy (5) 

ig2)y = f2V. + 3UVy (6) 
igi)y + (^2). = 2(/2K + fsVy) (7) 



giV, + g2Vy = (8) 

- Y iflV^xx + f2V^xy + hVxyy + fiVyyy + 4A3oo(xVy - l/K) + 2^201^ + 2^201^;) 

Equations ([5]), ([6]), and ([7]) are the same in the classical and quantum cases whereas 
(IH]) greatly simplifies for /i — > 0. In both cases ([5]), ([6]), and ^ are linear whereas ([8]) is 
nonlinear. 

The compatibility conditions for the first three determining equations provides a 
linear partial differential equation (PDE) for the potential 

= - + (2/2 - 3/4)V;Xy + (-3/1 + 2h)V^yy - hVyyy 

+ 2(/2j, — f?,y)Vxx + 2(— 3/ij/ + f2x + /s?/ — 3/4^)T4j^ + 2{ — f2y + f3x)Vyy 

+ (~3/lyj, + 2/2^:^ — f3xx)Vx + {~f2yy + 2/3^y — 3/42;2;)V"y. (9) 

Further compatibility conditions involving (j8]) exist but they are nonlinear and we shall 
not use them here. 

2.2. Potentials linear in y that admit a 3rd order integral 

In general the determining equations (IM9l) are difficult to solve. So far, they have been 
completely solved for potentials V{x,y) that allow separation of variables in Cartesian 
[6] or polar [25] coordinates. Here, on the contrary, we are looking for potentials that 
do not allow separation. To do this, we make the Ansatz, 

V{x,y) = Wi{x)y + Wo{x), wi{x) ^ 0, Wi : R ^ R, i = 0, 1.(10) 

Up to translation in x and y and an irrelevant constant, the only solution of the form 
( ITOl) of the determining equations in the quantum case is 

with a G M. The quantum integral of motion is 

9a 1 , 



X = 3pIp2 + 2pl + {— X3,pi} + {-^ - — ^,^2} (12) 



and the classical potential and integral are obtained by putting — > 0. They can of 
course also be obtained directly by requiring that the Poisson commutator {H,X}p 
vanish. 
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3.1. Determining equations 

Two basic results on n-th order integrals in E2, valid in both classical and quantum 
mechanics, are: 

• The leading (highest-order in the momenta) term lies in the enveloping algebra of 
the Euclidean Lie algebra e(2). 

• All lower order terms in the integral have the same parity as the leading term. 
It follows that a 4th order integral can be written as 

y ^{LIp'M+I i{9i{x,y),pl} + {92{x,y),piP2} + {g3{x,y),pl})+£{x,y), (13) 

j+k+l=4 

where the Aijh are real constants and gi,£ are real functions of {x,y). Since we are 
not aware of a proof of this result in the literature we provide one for n = 4 in the 
Appendix. The commutation relations [H, y] = provides 6 determining equations for 
the 5 functions V, gig2, gs and i namely 

9i,.^^fiV, + f2Vy (14) 
92,. + gi,y^Sf2V, + '2fsVy (15) 

93,x + g2,y = 2hV, + 3hVy (16) 

92,y = hV, + ^f5Vy (17) 

and 

4 = 2^1^^ + 52^ (18) 

+ T I ^^^^ ^^^^^^^ ~ ~ -^^^^^^^ ~ ~ -^^^^^^^ 

+ {f2,y — f5,x)Vxx — (13/i,j, + f4^x)Vxy ~ ^{f2,y — f^,x)yyy 

+ 2(6^4002;^ + 62^4002/^ + SAsoix - 29A310?/ + 8^220 + 8^202)^ 
+ 2(56A4ooa;y + l?>A^wx - IS^aoiy + 3A2ii)V^j;) 
£y^92V,+ 2g,Vy (19) 

+ ^ ( - (/2 + /4)Kxx + 4(/l - h)V,xy + ih - h)Vxyy 

+ 4(/l,j, — f4,x)Vxx ~ {f2,y + 13/5,a;)Mry — {fl,y — 3/4,a;)K/y 

+ 2{56A^ooxy - ISA^^oX + ISA^o^y + S^iOK 

+ 2(62^400^:' + 6A4002/' + 29A^30ia; - 8^3102/ + 9A202 + 3^220)^2,) • 

The polynomials fi are defined as 

/i = ^400?/^ - Aswy^ + A22oy^ - ^laoy + ^040 (20a) 
/2 = -AA^ooxy^ - Asoiy^ + SA^ioxy^ + A2uy^ - 2A22oxy - Ai2iy + Ai^qx + A031 (20&) 
/3 = 6^400X^2/^ + SA^oixy^ - SA^iox^y + ^202?/^ + ^220^;^ - Auy - A21X + A022 (20c) 
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/4 = -AA^ooyx^ + Asiox^ - SAgoiX^y + A2ux'^ - 2A202xy + Au2X - Aio^y + A013 {20d) 

h = A^oox^ + ^301^^ + A202x'^ + Alosx + Aoo4 (20 e) 

The compatibility condition for ( 1T4|) . (|T5|) . ([T6|l . and ( 1T7|1 is a fourth order hnear PDE 
for V given by 

= dyyy (4/i + ) " 9,,, (S/aF. + 

Equations (ITSl) and ( IT9|) have a compatibilty condition which is a non-hnear PDE 
for V, Qi, g2, Qs- Again, the classical determining equations are obtained in the limit 
h ^ 0. Thus, f|T^ . f|T5l) . f|T6|) . f|T71) and hence fl2Tl) are the same in classical mechanics 
but ( |T8l) and (flQl) have a quantum correction of order /i^. 

5".^. j4 superintegrable nonseparable system 

It is now quite easy to check that the potential (fTT!) satisfies the quantum and classical 
determining equations for the existence of a fourth order integral. Finally, we have 
obtained the main results of this article. 

Theorem 1 The operator triplet {H, X, Y) with 

X = 3pIp2 + 2pl + {— a;3,pi} + {-# - ^,^2} (23) 

constitutes a quantum superintegrable system that does not allow multiplicative 
separation of variables in the Schrddinger equation in any system of coordinates. 

Theorem 2 The triplet of well defined functions on phase space with 

H = \{pI+pI) + ^ (25) 

X = 3pIp2 + 2pl + 9ax^pi + ^p2 (26) 
y = p\ + -^P\ - I2x-^apip2 ^ 3 ^ (27) 

X3 X3 

constitutes a classical superintegrable system that does not allow additive separation of 
variables in the Hamilton- Jacobi equation in any system of coordinates. 



A nonseparable quantum superintegrable system in 2D real Euclidean space. 



6 



Both of these theorems are proved by directly verifying that they satisfy the determining 
equations. The nonseparabihty result follows from the fact that the Hamiltonian does 
not allow any second order integrals of motion. 

In the classical case it is easy to verify that {H,X,Y) of (125|) . ( 126|) and (p7|) are 
functionally independent. Indeed, the Jacobian matrix J satisfies 

j^ d{H,X,Y) ^ rank J = 3. (28) 
ox,y,pi,p2 

Hence, no nontrivial relations of the type = F{X, Y, H) exist (in particular there is 
no syzygy). In the quantum case, if a Jordan polynomial relation between the three 
integrals (!23l) . and (!22|) did exist, it would imply the existence of a syzygy in the 
classical limit h —> 0. 

The integrals of motion in both cases generate a finite dimensional decomposable 
Lie algebra 

{X, Y,I}®H (29) 

with 

[X,Y] = -108a\ (30) 

The algebra (!29l) is thus a direct sum of a Heisenberg algebra with H as an additional 
central element. 

4. Conclusion 

To our knowledge, (ITTi) is the first quantum nonseparable superintegrable system in the 
literature. Classical ones, on the other hand, are already known. To our knowledge, the 
first known one is the classical nonperiodic N particle Toda lattice. M Agrotis et al [1] 
have shown that the particle Toda system allows 2A^ — 1 integrals. A different classical 
nonseparable superintegrable system in complex two dimensional Euclidean space was 
recently presented by Maciejewski et al [T6] . 

The first systematic search for integrable systems with a third order integral in two 
dimensions was published by Drach in 1935 [2] and was conducted in a two dimensional 
complex space i?2(C). He found 10 families of potentials. One of them can be rewritten 
in real Euclidean space E2 as 

V = ^[a + by + c(4x2 + 3y^)) . (31) 

We see that the superintegrable potential ( 125|) is a special case of ( I3T1) (the constant a 
can be translated away for 6 7^ 0). For c 7^ (13T]) does not allow a fourth order integral, 
though it still might be superintegrable. 
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Appendix: Proof of equation ( I13|) 

Theorem 3 Given a self-adjoint Hamiltonian of the form 

H = ^{pl+pl) + V{x,y), V:R'^R. (A.l) 

Any fourth-order integral of motion, can be written in the form [T3\) modulo an all over 
complex constant and other integrals of motion. 

Proof: First, since H is a real differential operator, the real and imaginary parts of Y 
must commute with H separately and so Y can be assumed real and can be written as 

4 j 

with fj2e : ^ M and fj2e+i : iR. 

Next, note that H is self-adjoint and so any integral which commutes with it can be 
broken up into self-adjoint and skew-adjoint parts which will simultaneously commute 
with H. Further, at least one of the parts will remain fourth order and so, up to 
multiplication by a complex constant and modulo lower order terms, the constant of the 
motion can be assumed to be self-adjoint and can be written as 

r = i(rt + y) (A.3) 

which implies 

Y = l ({/,4,pipr^} + {f,2,pipl~-'} + fo,o + [.f,3,pipl-'] + Ifn^Pipl-']) . (A.4) 

However, the odd terms can be written as symmetrized even terms. Computing 
directly, 

= i^fu,x [/oi,P2] = ihfi2,y (A.5) 

[/33)Pl] = {~f33,xxx — 'if33,xxdx — 'if33,xdl) 
= ih^ (^ — f33,xxx — 2 {/sa.xi d^} + -/33,x3 

= ~^j33,xxx-\ ^{j33,x,Plf, (A.6) 

[/231P1P2] = "^^^ { — f23,xxy — '^f23,xydx — f23,xxdy — '2.f23,xdxdy — f23,ydl) 
= ih^ (^ — -j^if'^^^y^ '^x} ~ {f23,x, dxdy} + -f23,xxy 

= y{/23,y,P?} + iHf23,x,PlP2} + f23,xxy (A. 7) 

[fl3,PlPl] = -^{fl3,x,Pl} + iHfl3,y,PlP2} + — f 13, xyy (A. 8) 

[f03,pl] = ^f03,yyy + ^{f03,y,pl}- (A.9) 



and similarly 
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Here we recall that the the odd order functions are purely imaginary and so we can 
define new, real functions 



— J22 H ^J33,x -r ~^j23,y 

ai2 = fl2 + ihf23,x + ihfi3,y 

ih ^ 3i 

(122 



%1% ^ifl/ 

fo2 + —fl3,x H —fo3,y 



b = hi 



ih^ .ih^r 

-^J33,xxx + -^J23,xxy + -^Jl3,xyy + J03,yyy + + ^'^Jl2,?; 



(A.IO) 
(A.ll) 

(A.12) 
(A.13) 



To finish the theorem, we need only show that the highest-order terms lies in the 
enveloping algebra of the Euclidean Lie algebra e(2). If we compute the determining 
equations that result from the requirement that [Y, H] = 0, the differential equations 
that fj4 must solve are identical to those determined by the requirement that 

4 



j=0 



0. 



Thus, there exist constants Aijk such that the two operators ^{fj^iPiPi} ^ind 
Ajk^{Li^,p\p2} differ by at most lower order terms. However, since both of these 
operators are real and self-adjoint their difference must also be. Thus, the difference 
between the two operators is at most an order two differential operator which has only 
even terms in symmetrized form, as proven above. That is there exist real functions Cj2, 
d such that 

E ^{/.4yiP2} - E ^MiLip'A} = E 1{^^2,p',pI-'} + d. (A.14) 

j=0 j + k + l = 4: j = 

Finally, if we define 

5'i = ao2 + Co2, 92 = ai2 + ci2, ^3 = ^22 + C22 i = b + d (A.15) 
then, Y is of the form (IT^ . 



□ 
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